Imaging capturing device and imaging capturing method

ABSTRACT

An imaging device includes: an optical system which obtains an optical image of a photographic subject; an image sensor which converts the optical image to an electric signal; a digital signal processor which produces image data based on the electric signal; a display section which displays a photographic subject image expressed by the image data; and an operating section which performs a necessary setting regarding imaging, the digital signal processor including: an autofocus operation section which performs an autofocus operation based on data of an autofocus area set in the photographic subject image; a main area setting section which sets a main area in the photographic subject image; and a blurring operation section which performs a blurring operation on an area other than the main area in the photographic subject image, wherein the autofocus area is set automatically to overlap with at least a part of the main area.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.15/360,384, filed at the U.S. Patent and Trademark Office on Nov. 23,2016, which is a continuation of U.S. application Ser. No. 14/807,419(now U.S. Pat. No. 9,538,069) filed at the U.S. Patent and TrademarkOffice on Jul. 23, 2015, which is a continuation of U.S. applicationSer. No. 14/139,124 (now U.S. Pat. No. 9,154,687), filed at the U.S.Patent and Trademark Office on Dec. 23, 2013, which is a continuation ofU.S. application Ser. No. 12/960,946 (now U.S. Pat. No. 8,643,767),filed at the U.S. Patent and Trademark Office on Dec. 6, 2010 (now U.S.Pat. No. 8,643,767), which is based on and claims priority under 35U.S.C. § 119 to Japanese Patent Application No. 2009-277555 filed at theJapanese Patent Office on Dec. 7, 2009, and the entire contents of eachare incorporated herein by reference.

BACKGROUND

The present invention relates to an imaging device and an imagingmethod, which is used for an imaging processing mechanism of a digitalcamera in particular, and is applicable to mobile electronic devicessuch as a mobile phone, a PDA (personal digital assistant), and a toythat have an imaging device.

In recent years, digital cameras have been widely used. One of thefeatures of a digital camera is that a picture is freely created by auser while imaging or after imaging. And as such a creation technique,“a miniature faking photography technique” is known, in which alandscape photograph that has been imaged normally is created as if aminiature scale model was imaged at a close range. In many cases wherethe above technique is executed, retouching software for image editingis used and some procedures are taken. And additionally, a packagedsoftware that makes it easy to execute the miniature faking photographyhas also been disclosed.

Actual methods by using the retouching software are as follows.

1. Forming an image in which contrast and saturation are high byincreasing contrast and saturation of a photograph. (Improving ahazy-like state of an image which is seen in many landscape photographsand the like.)

2. Setting the depth of field shallow, that is, setting an in-focusrange narrow, in the case where the depth of field is deep, that is, arange of an in-focus distance is wide. (Blurring an area other than thatof a main photographic subject to be out-of-focus.)

By the above methods, anyone can easily perform “the miniature fakingphotography technique” on imaged photographs.

In Japanese patent application publication number 2009-27298, and apublished Japanese translation of PCT international publication forpatent application 2008-529322, a technique is disclosed that obtains animage in which a background is blurred like a portrait photograph insuch a manner that an AF (autofocus) area is determined, and a blurringoperation is performed on an area other than the AF area. However,Japanese patent application publication number 2009-27298, and apublished Japanese translation of PCT international publication forpatent application 2008-529322 discloses that the blurring operation isperformed, but do not relate to a miniature faking photography, and ablurring area is not specified.

However, performing an image processing operation by use of the aboveretouching software on a PC (personal computer) is a troublesome taskfor a user.

In the case of performing the miniature faking photography by performingthe image processing operation on an image after imaging, an in-focusarea which is in focus is not changed, because the in-focus area in theimage after imaging has been determined.

That is, as to a processing software in the case of performing theminiature faking photography, a miniature faking photograph is obtainedin such a manner that a main area to look like a miniature scale modelis set by a user, and a blurring operation to blur an area other thanthe set main area as a blurring area to be out-of-focus is performed.

However, in the case where the in-focus area and the main area set bythe user are different, if the miniature faking photography is performedon the image after imaging, there is a case where an area to look likethe miniature scale model in the image is not in focus, and thereforethere is a problem in that an effect of the miniature faking photographyis not obtained precisely.

SUMMARY

An object of the present invention is to provide an imaging device andan imaging method which execute a miniature faking photography operationin which a setting of a blurring area where a blurring operation isperformed is properly performed.

In order to achieve the object, the embodiments of the present inventionprovide: an imaging device comprising: an optical system which obtainsan optical image of a photographic subject; an image sensor whichconverts the optical image to an electric signal; a digital signalprocessor which produces image data based on the electric signal; adisplay section which displays a photographic subject image expressed bythe image data; and an operating section which performs a necessarysetting regarding imaging, the digital signal processor including: anautofocus operation section which performs an autofocus operation basedon data of an autofocus area set in the photographic subject image; amain area setting section which sets a main area in the photographicsubject image; and a blurring operation section which performs ablurring operation on an area other than the main area in thephotographic subject image, wherein the autofocus area is setautomatically to overlap with at least a part of the main area.

In order to achieve the object, the embodiments of the present inventionprovide: an imaging method, comprising: a step of obtaining an opticalimage of a photographic subject; a step of converting the optical imageto an electric signal; a step of producing image data based on theelectric signal; a display step that displays a photographic subjectimage expressed by the image data; an autofocus operation step thatperforms an autofocus operation based on data of an autofocus area setin the photographic subject image; a main area setting step that sets amain area in the photographic subject image; and a blurring operationstep that performs a blurring operation on an area other than the mainarea in the photographic subject image, wherein the autofocus area isset automatically to overlap with at least a part of the main area.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating a schematic structure of animaging device according to Embodiment 1 of the present invention.

FIG. 2A is an external top view of the imaging device according toEmbodiment 1, and illustrates a collapsed state of a lens barrel unit.

FIG. 2B is an external top view of the imaging device according toEmbodiment 1, and illustrates an extended state of the lens barrel unit.

FIG. 3 is an external view of the imaging device according to Embodiment1 seen from a photographic subject side.

FIG. 4 is an external view of the imaging device according to Embodiment1 seen from a photographer side.

FIG. 5 is a diagram illustrating a light receiving plane and an AF(autofocus) area of the imaging device according to Embodiment 1.

FIG. 6 is a flowchart illustrating a basic action of an AF operation.

FIG. 7 is an explanatory diagram of a smoothing and differentialtechnique used in a detecting operation of a peak of an AF evaluationvalue.

FIG. 8A is a diagram illustrating an example of an AF area which isdivided into 15 divisional areas in the imaging device according toEmbodiment 1.

FIG. 8B is a diagram illustrating an example of a display frame which isin-focus in the imaging device according to Embodiment 1.

FIG. 8C is a diagram illustrating an example of a main area and ablurring area in the imaging device according to Embodiment 1.

FIG. 9 is a flowchart explaining a selecting operation of a blurringarea setting operation of the imaging device according to Embodiment 1.

FIG. 10 is a flowchart explaining a blurring area setting operation by auser setting of the imaging device according to Embodiment 1.

FIG. 11A illustrates an example of setting of the main area in a roundshape according to Embodiment 1.

FIG. 11B illustrates an example of setting of the main area in arectangular shape according to Embodiment 1.

FIG. 12A illustrates an example of a screen for setting main andblurring areas in rectangular shapes according to Embodiment 1.

FIG. 12B illustrates another example of a screen for setting main andblurring areas in rectangular shapes according to Embodiment 1

FIG. 12C illustrates an example of a screen for setting main andblurring areas in round shapes according to Embodiment 1.

FIG. 12D illustrates another example of a screen for setting main andblurring areas in round shapes according to Embodiment 1.

FIG. 13A is a diagram illustrating a relationship between a blurringarea and a main area.

FIG. 13B is another diagram illustrating a relationship between ablurring area and a main area.

FIG. 13C is another diagram illustrating a relationship between ablurring area and a main area.

FIG. 13D is another diagram illustrating a relationship between ablurring area and a main area.

FIG. 14 is a flowchart explaining a blurring area setting operation byan automatic setting of an imaging device according to Embodiment 2 ofthe present invention.

FIG. 15A is an example in the imaging device according to Embodiment 2and a diagram illustrating a display frame for an object.

FIG. 15B is an example in the imaging device according to Embodiment 2and a diagram illustrating a main area and a blurring area for theobject.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, embodiments in the present invention will be explained withreference to the drawings.

FIG. 1 is a block diagram illustrating a schematic structure of animaging device according to Embodiment 1 of the present invention. FIGS.2A and 2B are external views of the imaging device (digital camera 1)seen from above according to Embodiment 1. FIG. 2A illustrates acollapsed state of a lens barrel unit 2 and FIG. 2B illustrates anextended state of the lens barrel unit 2. FIG. 3 is an external view ofthe imaging device (digital camera 1) seen from the front, that is, seenfrom a photographic subject side. FIG. 4 is an external view of theimaging device (digital camera 1) seen from the back, that is, seen froma photographer side.

As illustrated in FIG. 1, in the imaging device (digital camera 1), animaging lens section (an optical system) in the lens barrel unit 2includes a zoom lens, a focus lens, a mechanical shutter, and anaperture. Each of the zoom lens, the focus lens, the mechanical shutter,and the aperture is respectively controlled by a zoom lens controller21, a focus lens controller 22, an aperture and shutter controller 23,and a lens barrel controller 24. Specifically, the zoom lens controller21 implements a zoom function. The focus lens controller 22 has afunction to perform a focusing operation on a photographic subject. Theaperture and shutter controller 23 controls brightness of thephotographic subject and performs a shutter control. The lens barrelcontroller 24 extends the lens barrel unit 2 when starting up andcollapses the lens barrel unit 2.

The zoom lens and the focus lens are operated by a motor (notillustrated). FIG. 2A is an external view illustrating a state where thelens barrel unit 2 is collapsed, and FIG. 2B is an external viewillustrating a state where the lens barrel unit 2 is extended. FIGS. 2Aand 2B are views of the digital camera 1 seen from above. On the top ofthe digital camera 1, a shutter release button 4, a mode dial 5, and apower switch 3 are arranged.

And FIG. 3 is an external view of the imaging device (digital camera 1)seen from a photographic subject side, and FIG. 4 is an external view ofthe imaging device (digital camera 1) seen from a photographer side.

The mode dial 5 provides an imaging mode, a playback mode which is fordisplaying an imaged image, a setup mode which is for setting varioussettings, a portrait mode which is for imaging a person, a night viewmode which is for imaging a night view, and so on to a user. The userperforms switching of each of the modes by the above mode dial 5.

In Embodiment 1, “a miniature faking photography mode” (an imaging modewhich processes an imaged image to look as if a miniature scale modelwas imaged, and records the processed image) can be assigned to the modedial 5 as well. For example, in the case where the mode dial 5 is set tothe imaging mode, the lens barrel unit 2 is extended to a photographableposition, and the digital camera 1 enters a monitoring (live-preview)state.

The monitoring state is a state where a user who performs a shootingsees a photographic subject on a display section (LCD monitor) 18illustrated in FIG. 4 in real time. In this state, a shutter is in anopen state, and an image formed by light received through the focus lensand the zoom lens is converted to an electric signal by a CCD(charge-coupled device) or a CMOS (complementary metal-oxidesemiconductor), each of which is an image sensor, of a CCD/CMOS section20, and then transfers to an image processing section 25 as image data.An image expressed by the image data is displayed on the display section(LCD monitor) 18 in real time. Normally, an image of 640×480 pixels istransferred at 30 frames per second, and the user confirms thephotographic subject in real time by the image displayed on the displaysection (LCD monitor) 18, and waits for a chance to press a shutterrelease button 4.

Most of the shutter release buttons are two-step type. The shutterrelease button 4 is a two-step shutter release button, and a state wherethe shutter release button 4 is half-pressed is defined as a first step,and a state where the shutter release button 4 is fully-pressed isdefined as a second step. An autofocus (AF) operation is performed bythe first step, that is, when the shutter release button 4 ishalf-pressed. In other words, at this time, focus is locked (focus lockis performed). The focus lock will be explained as follows.

When the shutter release button 4 is half-pressed (first step), an AF(autofocus) evaluation value and an AE (automatic exposure) evaluationvalue are calculated based on a YUV signal taken in the image processingsection 25 from the CCD/CMOS section 20. The AF evaluation valueexpresses a degree of focus of the imaged image, and the AE evaluationvalue expresses an exposure state. Data of the AF evaluation value isread out to a system controller 29 as characteristic data and is usedfor an autofocus (AF) operation. In an in-focus state, an edge part of aphotographic subject in an image is sharp, and accordingly, as tointegral values of the AF evaluation value, a high-frequency componentof the image becomes maximum. By use of the integral values of the AFevaluation value, an in-focus state detection is performed bycalculating an AF evaluation value at each position of the focus lens,and detecting a point (peak position) where the AF evaluation valuebecomes maximum.

Additionally, in consideration of a case where there is a plurality ofpoints where the AF evaluation value becomes maximum, in the case wherethere is the plurality of points where the AF evaluation value becomesmaximum, magnitudes of AF evaluation values at peak positions, anddegrees of rise and fall of values between the AF evaluation values atthe peak positions and those in their vicinities are examined, and amost reliable point is taken as an in-focus position, and the AFoperation is executed.

The AF evaluation value is calculated from a specific range of aphotographic subject image expressed by the imaged image data, that is,a specific range of a light receiving plane 20 a of the CCD/CMOS section20. A center frame in the display section 18 is an AF (autofocus) areaof the digital camera 1. As illustrated in FIG. 5, an AF area 20 b is60% the size of that in a horizontal direction (L) and 50% the size ofthat in a vertical direction (H) of the light receiving plane 20 a ofthe CCD/CMOS section 20.

Next, as to the AE evaluation value, the light receiving plane 20 a ofthe CCD/CMOS section 20 is divided into areas (16 horizontal×16 verticalareas in this digital camera 1), which are not illustrated, andluminance data measured in the areas is used. As to each pixel in eachdivided area, a pixel of which the luminance value exceeds apredetermined threshold value is taken as a target pixel. The AEevaluation value is obtained such that the luminance value of the targetpixel is added and multiplied by the number of target pixels. A properexposure amount is calculated by luminance distribution of each dividedarea, and the calculation result is fed back to imaging of a next image.

A basic action of the AF operation is performed based on a flowchart ofFIG. 6. The focus lens is moved by only a predetermined pulse amount(step S1), and then the AF evaluation value is obtained based on data ofan AF area (step S2). By results obtained from a smoothing anddifferential calculation of the AF evaluation value (step S3), adetecting operation of a peak of the AF evaluation value (step S4) andso on, whether the peak of the AF evaluation value is detected or not isconfirmed (step S5). In the case where the peak is detected (YES of stepS5), a position of the focus lens where the AF evaluation value becomesthe peak is determined as the in-focus position (step S9), and then theoperation ends. In the case where the peak is not detected (NO of stepS5), whether the focus lens is at a predetermined end position ofmovement of the focus lens or not is confirmed (step S6). In the casewhere the focus lens is not at the predetermined end position (NO ofstep S6), the focus lens is moved again until the focus lens is at thepredetermined end position, and a calculation of the AF evaluation valueis repeatedly performed, and when the peak is detected, the operationends.

In the case where the focus lens is moved to the predetermined endposition and the peak is not detected (NO of step S6), that is, in thecase where focus is not determined from a closest distance to infinity,a peak area selecting operation is performed (step S7).

In the case where AF evaluation values in the closest distance side arelarge and AF evaluation values in the side of the middle and longdistance to infinity are small, it is determined that the photographicsubject is too close and the AF operation is unable to be performed, andan indication of “AF operation unavailable” is displayed on the displaysection 18 (step S8), and the operation ends.

As a method of detecting the peak of the AF evaluation value, asmoothing and differential technique is used. A point where a value ofthe AF evaluation value becomes a negative value from 0 (zero) is takenas the peak of the AF evaluation value (see FIG. 7).

Regarding the AF operation, there are types of a one-shot AF, a movingobject tracking AF, and so on. In the one-shot AF, the photographicsubject is focused by the above-described first step. In the movingobject tracking AF, for example, a face of a photographic subject isdetected, and the detected face is brought into focus, and then if thedetected face is moved, the detected face is continuously focused. Themoving object tracking AF is that in which a moving object is trackedand focused continuously.

FIGS. 8A to 8C illustrate examples of a multi-area AF. In the exampleillustrated in FIG. 5, the AF area is one area; however, in an exampleof the multi-area AF, as illustrated in FIG. 8A, an AF area 20 bincludes 15 divided areas, and the peak is detected in each divided AFarea 20 b. A case where equal to or more than two peaks are detected inadjacent divided areas is taken to be focused. In order to inform a userof being focused, a display frame 18 a illustrated by a chain line inFIG. 8B is displayed on the display section 18, and an alarm soundinforming of being focused goes off.

As to ordinary digital cameras, the power is supplied from batteries forexclusive use, AA batteries, and so on, and a suitable voltage issupplied to each block from a power supply circuit section 16illustrated in FIG. 1 such as a DC-DC converter. The image processingsection 25 performs various types of image processing on the image data.When the second step is performed (the shutter release button 4 isfully-pressed), an imaged image is transferred to the image processingsection 25.

Additionally, in the image processing section 25, the imaged image (RGBdata) is converted to YUV data (Y: luminance data; U and V: colordifference data). And the image processing section 25 has a compressingand extending function that compresses YUV data in a JPEG-compliantcompression format and extends compressed image data, and an imageprocessing function that performs a blurring operation on a specifiedarea.

Memory sections (volatile memory and non-volatile memory) 26 and 27 ofSDRAM, flash memory and the like, an external memory I/F (interface)section 17, the system controller 29, a USB communication section 12,the display section 18, and a clock 28 are connected to each other by asystem bus 30.

Conditions when imaging and a name of a digital camera are added to thecompressed image data as a header of JPEG data to be an Exif-compliantfile format of digital cameras, and then the image data to which theheader has been added is temporarily stored in the memory section(volatile memory: SDRAM) 26 as a JPEG file. The external memory card I/Fsection 17 is provided so that an external memory card is detachable,and the above JPEG file is stored in the external memory card. As theexternal memory card, there are several kinds such as a CompactFlash(registered trademark), an SD memory card 7, and so on.

A digital signal processor (DSP) 31 includes the image processingsection 25, the memory sections 26 and 27, the clock 28, and the systemcontroller 29.

Embodiment 1

FIGS. 9 and 10 are flowcharts explaining operations of the imagingdevice according to Embodiment 1. In particular, FIG. 9 is a flowchartexplaining a selecting operation of a blurring area setting operation,and FIG. 10 is a flowchart explaining a blurring area operation by auser setting.

In accordance with FIGS. 9 and 10, the operations of the imaging deviceaccording to embodiment 1 will be explained with reference to FIGS. 1 to8.

As illustrated in FIG. 9, the power of the digital camera 1 is ON (stepS11). Firstly, an operation program is operated in the system controller29 and reading of settings performed in a setup operation of the setupmode is performed (step S12). Contents of the settings are stored in thememory section (non-volatile memory) 27, and the contents are not lostwhen the power is turned OFF.

In Embodiment 1, for example, as the contents of the settings forperforming “a miniature faking photography”, whether “setting a blurringarea by a user (user setting)” or “setting automatically a blurring areabased on an AF operation result (automatic setting)” is set by a user isconfirmed (step S13). In the case of “the user setting” in step S13, theoperation moves to the operation of the flowchart illustrated in FIG.10. And in the case of “the automatic setting” in step S13, theoperation moves to an operation of a flowchart illustrated in FIG. 14.

In the setup operation of the setup mode, by use of a menu button 15 a,up, down, right, and left buttons 14 b to 14 e as the operating section19 illustrated in FIG. 4, the user sets the settings whilst looking atthe display section (LCD monitor) 18. The settings set by the user hereare stored in the memory section (non-volatile memory) 27.

Next, in the case of “the user setting” in step S13 of FIG. 9, asillustrated in the flowchart of FIG. 10, whether the mode setting is“the miniature faking photography” (hereinafter, it is referred to as “aminiature mode”) or not is confirmed (step S14). Whether the modesetting is the miniature mode or not is confirmable based on thesettings of the mode dial 5.

In the case where the mode setting is not the miniature mode (NO of stepS14), a monitoring operation in a normal imaging is performed (stepS15). On the other hand, in the case where the mode setting is theminiature mode (YES of step S14), based on the settings of the blurringarea set by the user, a pseudo-blurring operation is performed, and thenthe monitoring operation is performed (step S16). Additionally, when thefirst step is performed, the AF operation is executed.

An example of the blurring area set by the user is illustrated in FIG.11A. In FIG. 11A, a main area 18 c where the blurring operation is notperformed is set at the lower left. An intermediate area 18 d where aslight-blurring operation is performed is set in the vicinity of themain area 18 c. A blurring area 18 b where the blurring operation isperformed is set for an area other than the main area 18 c and theintermediate area 18 b.

In FIG. 11B, the main area 18 c illustrated by a rectangular shape wherethe blurring operation is not performed, the intermediate area 18 dwhere the blurring operation is slightly performed, and the blurringarea 18 b where the blurring operation is performed are set.

In the case of performing the pseudo-blurring operation on an image whenmonitoring, to help the user understand easily, an OSD (on-screendisplay) can be displayed on the display section 18. For example, inparticular, the main area 18 c is displayed as transmittance of 100%,and the blurring area 18 b is displayed as transmittance of 50%.Therefore, without actually performing the blurring operation onmonitoring image data, it is possible for the user to recognize the setblurring area 18 b while monitoring and perform imaging.

In the case where there is a user request to change the blurring area 18b when monitoring (step S17), and when the above user request isconfirmed (YES of step S17), the operation moves to an operation to setthe blurring area 18 b (step S18). Pressing a display button 15 d ofFIG. 4 is a trigger of the operation to set the blurring area 18 b, andwhen the user presses the display button 15 d, a setting screen of amain area and blurring area as illustrated in FIGS. 12A to 12D isdisplayed. In the case of setting a main area in a rectangular shapesuch as FIGS. 12A and 12B, the main area 18 c is moved up and down by anup-and-down key (an operation of an up button 14 b and a down button 14c). A width of the main areas 18 c is changed by a right-and-left key(an operation of a left/flash button 14 e and a right/micro button 14d).

In the case of setting a main area in a round shape such as FIGS. 12Cand 12D, the main area 18 c is moved by an up-down-right-and-left key(an operation of the buttons 14 b to 14 e), and becomes larger by anoperation of a zoom switch (wide-angle) 13 a, and becomes smaller by anoperation of a zoom switch (telephoto) 13 b.

When the blurring area 18 b is changed in step S18, the operationreturns to step S16, and based on the changed blurring area, thepseudo-blurring operation is performed and then the monitoring operationis performed.

Thus, the main area 18 c and the blurring area 18 b are settable by theuser. At this time, when the first step is performed, the AF operationis performed. An AF area where the AF operation is performed is setbased on the main area 18 c set by the user. Examples of a relationshipbetween the main area 18 c and the AF area 20 b are illustrated in FIGS.13A to 13D. In the case of FIG. 13B, a width of the main area 18 c in avertical direction of FIG. 13B is narrow, and a center line in alongitudinal direction is set in a top part of the light receiving plane20 a of the CCD/CMOS section 20. In this case, the AF area 20 b is alsoset as well as the main area 18 c. A width of the AF area 20 b in thevertical direction of FIG. 13B is narrow, and a center line in thelongitudinal direction is set in the top part of the light receivingplane 20 a of the CCD/CMOS section 20. In this case, the AF area isnarrower than that in the case where the blurring operation is notperformed (see FIG. 5), therefore a speed of the AF operation is fast.

In addition, whether the digital camera 1 is in a moving object trackingAF mode or not is confirmed (step S19). Here, in the case of the movingobject tracking AF mode when monitoring (YES of step S19), for example,in the case of a face detection AF mode, whether there is a face or notin a monitoring image when monitoring is detected. Once a face isdetected, a motion of the detected face is tracked and the AF operationis always performed on the detected face as an object when monitoring.In the case where the blurring operation is not performed, an area wherea face detection is performed is the AF area, however in the case wherethe blurring area is set as illustrated in FIG. 13A and the blurringoperation is performed, the face detection is performed on the main area18 c, and therefore a speed of the face detection is fast. Additionally,in the case where the face moves outside the main area 18 c, the facedetection is stopped (step S20).

A face tracking described above is performed based on an optical flowcalculated based on differences between a plurality of photographicsubject images.

As well as the AF operation, exposure control is also performed by theaperture and shutter controller 23 illustrated in FIG. 1, and theaperture and shutter controller 23 controls exposure to be adjustedmainly in the main area.

Whether the shutter release button 4 is pressed (second step) or not isconfirmed (step S21). In the case where the second step is not performed(NO of step S21), the operation returns to step S16, and the monitoringoperation is repeated. In the case where the second step is performed(YES of step S21), the AF operation, an exposure operation, setting ofthe blurring area, and so on are performed (step S22). The shuttercontrol is performed, and data of the imaged image is transferred to theimage processing section 25 from the CCD/CMOS section 20, and thenstored in the memory section 26 (step S23). The image data stored in thememory section 26 is taken as first image data. And the first image datais copied into a different area of the memory section 26. The copiedimage data is taken as second image data.

The blurring operation is performed on a predetermined blurring area 18b set by the user of the second image data (step S25). And then, each ofthe first and second image data is compressed as an image file in JPEGformat, and is stored on the SD memory card 7, for example (step S26).

In Embodiment 1, the main area is taken as the AF area. However, forexample, in the case of the moving object tracking AF mode, when anobject moves outside the main area, the AF operation is not performed.Therefore, there is no longer a chance of performing a wasted AFoperation and exposure operation.

Embodiment 2

FIG. 14 is a flowchart explaining an operation of the imaging deviceaccording to Embodiment 2 of the present invention. In particular, FIG.14 is a flowchart explaining the blurring area setting operation by theautomatic setting.

In accordance with FIG. 14, the operation of the imaging deviceaccording to Embodiment 2 of the present invention will be explainedwith reference to FIGS. 1 to 8. Here in FIG. 14, steps equivalent to thesteps explained by FIG. 10 will be denoted by the same referencenumerals.

In the case where setting of the blurring area is the automatic settingin step S13 illustrated in FIG. 9, as illustrated in the flowchart ofFIG. 14, whether the mode setting is the miniature mode or not isconfirmed (step S14). In the case of the miniature mode (YES of stepS14), the first step is performed and the AF operation is executed. Anda main area is automatically set based on an AF area where the AFoperation is performed. For example, a centroid of the AF area and acentroid of the main area are set to be overlapped. And the blurringoperation is performed in the vicinity of the main area as a blurringarea. In this case, so as to be easily recognized by a user, in the caseof the first step, the OSD (main area 18 c) in a rectangular shape canbe performed as illustrated in FIG. 8C. And additionally, in the case ofa round shape, the OSD (main area 18 c) can be performed as illustratedin FIG. 15B.

In Embodiment 2, the main area and blurring area are set automatically,therefore without performing the operation to set the blurring area(steps S16 to S18 illustrated in FIG. 10), whether the digital camera 1is in the moving object tracking AF mode or not is confirmed (step S19).In the case of the moving object tracking AF mode (YES of step S19), inplace of step S20 of FIG. 10, the main area is always set based on theAF area, and the vicinity of the main area is set as the blurring area,and then a monitoring image is displayed on the display section (LCDmonitor) 18 as described later (step S30).

In the case where a face has been detected in the moving object trackingAF mode, when monitoring, by a display frame 18 a illustrated by a chainline as illustrated in FIG. 15A, the OSD is performed to recognize thedetected face. In the case of the miniature mode, as illustrated in FIG.15B, a main area 18 c and a blurring area 18 b can be displayed in sucha manner that transmittance of the main area 18 c is 100%, andtransmittance of the blurring area 18 b is 50%.

The operation from step S21 is the same as Embodiment 1 (see FIGS. 10and 14).

In addition, according to Embodiment 2, if a main area is at anarbitrary position in the light receiving plane 20 a of the CCD/CMOSsection 20, the main area is automatically set and a blurring area isset in the vicinity of the main area. Therefore, a task to set the mainarea is reduced.

The digital signal processor (DSP) 31 corresponds to an autofocusoperation section, a main area setting section, a blurring operationsection, an autofocus area setting section, a face detecting section,and a moving object tracking operation section.

The imaging device and imaging method according to the embodiments ofthe present invention apply to electronic devices such as a mobilephone, a personal digital assistant (PDA), a toy, and the like.

According to the embodiments of the present invention, it is possible toprecisely obtain an effect of the miniature faking photography, becausethe blurring area is suitably set.

Although the present invention has been described in terms of exemplaryembodiments, it is not limited thereto. It should be appreciated thatvariations may be made in the embodiments described by persons skilledin the art without departing from the scope of the present invention asdefined by the following claims.

What is claimed is:
 1. An imaging device comprising: an image sensorwhich takes an image of a subject to output image data; a display whichdisplays a display image based on the image data; a processor whichperforms a blurring process on the image data to blur at least a partialarea of the display image displayed by the display; a shutter button forperforming an AF operation in response to being pressed halfway and forrecording the image data on which the blurring process has beenperformed in a detachable memory card in response to being pressed allthe way down; and an inputting member for inputting an instruction todetermine a not-blurring area that is a belt-like area passingtransversally across the display image on which area the blurringprocess is not performed and a blurring area on which area the blurringprocess is performed, wherein for a case where the shutter button hasnot been pressed, the display displays the display image based on theimage data on which the blurring process has been performed at theblurring area, and, in response to the shutter button being pressedhalfway in a state of displaying the display image, the display displaysan AF frame depending on the not-blurring area.
 2. The imaging deviceaccording to claim 1, wherein in response to the shutter button beingpressed halfway, the processor sets a position to display the AF frameat a position that includes a center of the not-blurring area.
 3. Theimaging device according to claim 2, wherein the processor moves thenot-blurring area in response to the inputting member being operated toinput an instruction to move the not-blurring area, the display displaysa rectangular area corresponding to the not-blurring area that has beenmoved, and in response to the shutter button being pressed halfway in astate where the not-blurring area has been moved, the processor changesthe position to display the AF frame according to the position of thenot-blurring area that has been moved.
 4. The imaging device accordingto claim 1, wherein the display displays a rectangular areacorresponding to the not-blurring area for a case where the shutterbutton has not been pressed.
 5. The imaging device according to claim 4,wherein the display displays the AF frame having a horizontal lengthshorter than a horizontal length of the rectangular area in response tothe shutter button being pressed halfway.
 6. The imaging deviceaccording to claim 1, wherein for a case where the shutter button hasnot been pressed, the instruction is inputtable with the inputtingmember.
 7. The imaging device according to claim 1, wherein the displayimage displayed by the display includes at least an area correspondingto the blurring area, an area corresponding to an area that is includedin the not-blurring area and is an area that is in a focused stateachieved by the AF operation, and an area corresponding to an area thatis included in the not-blurring area and is an area other than the areathat is in the focused state.
 8. An imaging device comprising: an imagesensor which takes an image of a subject to output image data; a displaywhich displays a display image based on the image data; a processorwhich performs a blurring process on the image data to blur at least apartial area of the display image displayed by the display; a shutterbutton for performing an AF operation in response to being pressedhalfway and for recording the image data on which the blurring processhas been performed in response to being pressed all the way down; and aninputting member for inputting an instruction to determine a first areaon which the blurring process is performed and a second area on whichthe blurring process is not performed, wherein for a case where theshutter button has not been pressed, the display displays the displayimage based on the image data on which the blurring process has beenperformed at the first area, and, in response to the shutter buttonbeing pressed halfway in a state of displaying the display image, thedisplay displays an AF frame depending on the second area.
 9. Theimaging device according to claim 8, wherein in response to the shutterbutton being pressed halfway, the processor sets a position to displaythe AF frame at a position that includes a center of the second area.10. The imaging device according to claim 9, wherein the processor movesthe second area in response to the inputting member being operated toinput an instruction to move the second area, the display displays arectangular area corresponding to the second area that has been moved,and in response to the shutter button being pressed halfway in a statewhere the second area has been moved, the processor changes the positionto display the AF frame according to the position of the second areathat has been moved.
 11. The imaging device according to claim 8,wherein the display displays a rectangular area corresponding to thesecond area.
 12. The imaging device according to claim 8, wherein for acase where the shutter button has not been pressed, the instruction isinputtable with the inputting member.